POINT PROCESSES AND 
THE INFINITE SYMMETRIC GROUP 
; PART III: FERMION POINT PROCESSES 
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Abstract. In Part I (G. Olshanski) and Part II (A. Borodin) we developed an 
approach to certain probability distributions on the Thoma simplex. The latter has 
infinite dimension and is a kind of dual object for the infinite symmetric group. 
Our approach is based on studying the correlation functions of certain related point 
stochastic processes. 

In the present paper we consider the so-called tail point processes which describe 
the limit behavior of the Thoma parameters (coordinates on the Thoma simplex) 
with large numbers. The tail processes turn out to be stationary processes on the 
real line. Their correlation functions have determinantal form with a kernel which 
generalizes the well-known sine kernel arising in random matrix theory. Our second 
result is a law of large numbers for the Thoma parameters. We also produce Sturm- 
Liouville operators commuting with the Whittaker kernel introduced in Part II and 
q5 '. with the generalized sine kernel. 
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The present note is a continuation of [0] (Part I) and [Bl] (Part II). Our aim 
here is to draw some conclusions from the computations of Part II. 

In Part I we started the study of a family {P zz '} of probability Borel measures 
living on an infinite-dimensional simplex fi, the Thoma simplex. Recall that this 
family consists of two parts: the principal series and the complementary series, each 
of which is indexed by two real parameters. For the principal series, z is an arbitrary 
complex number distinct from 0, ±1, ±2, . . . , and z' = z. For the complementary 
series, z and z' are real numbers which are both contained in a unit interval with 
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integer ends. When z is a noninteger real number and z' = z, the corresponding 
measure belongs to the intersection of the both series. 

Note that z — z' ranges over the imaginary axis plus the open interval (—1,1) 
- a picture that immediately evokes the principal and complementary series for 
SL(2,R). 

The measures P zz > originated from the work [KOV]: they govern the decompo- 
sition of certain reducible representations which seem to be right analogs of the 
regular representation for the infinite symmetric group. It is known that, excepting 
the symmetry relation P zz > = P z > z , the measures P zz > are pairwise disjoint. 

Recall that the points of the Thoma simplex O are the double sequences a = 
(a > a 2 > ■ ■ ■ > 0), /?=(/?!> > ■ ■ ■ > 0) such that J2( a j + Pj) < 1 - The 
basic idea of Part I was to interpret the measures P zz > as point processes (denoted 
as V zz >) on the punctured interval I = [—1,1] \ {0}, the random configuration 
being of the form (— j3\, — fa, ■ ■ ■ , ot2, cti), where only nonzero otj's and fi/s are 
considered and the points are accumulated near 0. A method of calculating the 
correlation functions pn Z \ n = 1, 2, . . . , of the processes V zz > was developed. In 

(zz') 

Part I, we calculated the first correlation function p\ , and in Part II — the higher 

(zz') 

correlation functions p n . More advanced results were obtained for the process 
the restriction of V zz > to (0, 1] C /. The process V£ z , reflects the behavior 
of the Thoma parameters aj; the study of the /?j's is reduced to that of the ctj's 
simply by change of the sign for z and z' . 

The initial definition of the processes V zz i is rather indirect and we know no ex- 
plicit probabilistic mechanism generating them. From the beginning it was unclear 
what known processes they resemble. Now, the knowledge of the correlation func- 
tions makes it possible to conclude that V zz i (or at least certain derived processes) 
are similar to the point processes arising in the scaling limit of certain random 
matrix ensembles. The basic common feature is that the correlation functions 
are given by determinantal formulas involving a kernel; such processes are called 
fermion point processes after [Mai, Ma2, DV]. Note that determinantal correlation 
functions also appear in certain models of mathematical physics [KBI]. 

The results of Part II lead to interesting kernels: the Whittaker kernel (see 
sections 1-2), the sin/ sh kernel, the sh / sh kernels and their degenerations (see 
sections 3-4). The Whittaker kernel seems to be a new example; the sin / sh kernel 
already appeared in works of mathematical physicists, see [BCM, MCIN]. We think 
that the connection of our problem with the random matrix theory is interesting 
and promising. 

The note is organized as follows. In section 1, we briefly review some general 
facts about the fermion processes. In section 2, we discuss the "lifting" of the 
process V zz ,, which leads to the Whittaker kernel. As an application, we calculate 
the mean value for Yl a i an d ^2 Pi- In section 3, we introduce the "tail process" 
for V^ z r, it turns out to be a stationary fermion process on K. depending on z, z'. 
In this way, we get a two-parametric family of kernels generalizing the sine kernel; 
they are discussed in section 4. In section 5, we prove that 

lim a)' 3 = lim = e~ l ' c ', 

with probability 1, where C > is a certain (explicitly determined) constant de- 
pending on z, z' . Roughly speaking, this means that the Thoma parameters decay 
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with the rate of a geometric progression. In section 6, we produce the Sturm- 
Liouville differential operators which commute with the integral operators given 
by the Whittaker kernel and the stationary kernels of section 4. In section 7, we 
compare the processes V^ z , with the Poisson-Dirichlet processes VT>{t) [Ki]. 

1. The fermion point processes. Let V be a point process on a space X and 
p n (xi, . . . , x n ) denote its correlation functions relative to a reference measure p, on 

X, n = 1, 2, By a test set A C X we mean a Borel set such that the first 

correlation function p\ is integrable on A; this means that A intersects the random 
configuration at a finite number of points with probability 1. 

In many concrete situations, it turns out that the functions p n are given by a 
determinantal formula, 

p n {xi, . . . , x n ) = det[K(x a , x b )]^ b=1 , 

where K(x, y) is a kernel on X x X not depending on n. 

The processes with determinantal correlation functions seem to be important 
enough to deserve a special name. Though key examples of such processes were al- 
ready considered in the 1st edition (1967) of Mehta's book on random matrices [Me] 
and some earlier papers, the first (to our knowledge) general discussion appeared 
in Macchi's paper [Mai]. In her works and in the book [DVJ] these processes are 
called the fermion point processes, and we shall adopt this terminology. 

Let us list some general properties of the fermion processes (see [Mai, Ma2] and 
[DVJ], Example 5.4(c) and Exercises 5.4.7-9). 

If the reference measure p is replaced by an equivalent one, p i— > fp, where / is 
a strictly positive function, then the kernel must be divided by a/ f(x)f(y). 

Note that a determinantal correlation function vanishes when some of the argu- 
ments coincide; this means that the points of the random configuration have some 
repulsion properties. 

Given a kernel K(x, y), the following conditions ensure the existence of a fermion 
process, see [Mai]: 

(*) The functions p n as defined above are nonnegative. 
(**) For a test set A C X, let Ka denote the integral operator whose kernel 
Ka(x, y) is defined as the restriction of K(x, y) to Ax A. It is required that 
the norm of Ka in L 2 {A, p) be strictly less than 1 for any test set A. 

In many cases the kernel K(x,y) turns out to be symmetric, so that Ka is a 
nonnegative self-adjoint operator in the Hilbert space L 2 (A, p). But there also exist 
interesting examples of non symmetric kernels (see, e.g., [B2]). Even for symmetric 
kernels, a direct verification of the above sufficient conditions can be difficult. 1 But 
K(x,y) often arises as a limit of kernels which certainly satisfy (*) and (**). In 
such a situation we can conclude at least that K{x,y) satisfies (*) and \\Ka\\ < 1, 
which is a weak form of (**). 

Let us denote by TTn • • • , x n ) the finite-dimensional distribution functions 
of V. Here n = 1, 2, . . . , A C X is a test set and, by definition, 

tt^\xi, . . . ,x n )p(dxi) . . . p(dx n ) = Probjexactly n points in A, 
one point located in each of the infinitesimal regions dxi}. 

1 It greatly simplifies when K(x,y) is a translation invariant kernel, say, on the real axis, see 
section 4 below. 
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By the well-known inclusion-exclusion principle, the n functions can be expressed 
through the p functions as follows 



00 (-l) fc f 
k=o K - jAk 

see [DVJ], section 5.4. For the fermion processes this relation takes the following 
form 

tt^{x\, ...,i„) = Det(l - K A ) det[L A (x a , x b )}, 

where Ka is the integral operator whose kernel Ka(x, y) is obtained by restricting 
the kernel K(x,y) to A x A, Det is the Fredholm determinant Det(l — XKa) eval- 
uated at A = 1, and L^(x,y) is the kernel of the operator La '■= Ka{1 — Ka) -1 - 
In particular, the probability tv^ that A is empty of points of the random config- 
uration equals Det(l — Ka)- 

For a fermion process on the line, there is a relation between the Fredholm 
determinant and the probability distribution of the spacings, see, e.g., [TW4], first 
formula after (5.35). For other relations involving the Fredholm determinant, see 
[Me, TW1]. 

Now let us give examples of the kernels K(x,y) originated from concrete prob- 
lems. 

The most known is the sine kernel 

sin7r(;r — y) m 

K{x,y) = —± fi, x,yeR. 

7i{x - y) 

It appears in scaling limit of various random matrix ensembles "in the bulk of the 
spectrum", see [Me, NW1, TW1]. Since the kernel is translation invariant, the 
corresponding process is stationary. The sine kernel can be included into a more 
general family of translation invariant kernel, see section 4 below. 2 

Taking scaling limit "at the edge of the spectrum" leads to other kernels: the 
Airy kernel 

Ai(x)Ai'(y) - Ai(y)Ai'(x) 

K(x,y) = ^^ ^ ^ x,yeR 

x-y 

(where Ai(-) is the Airy function) and the Bessel kernel 

( A _ Jgjx-^J^yh) - J a {y*)x*J' a {x%) 
K{x,y)- 2(x-y) ' lV 

(where J Q (-) is the Bessel function of order a > -1), see [F, NW2, TW2, TW3]. 

The results of Part II, section 3, lead to one more kernel expressed through 
special functions, the Whittaker kernel 

K(x, y) = const -(xy) 2 ^--^ J --^ ^--^ u±±_^_ , x, y > 

x-y 



2 About the meaning of the factor tt, see the first comment to Proposition 4.2. 
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(where W Kifl (-) is the Whittaker function, a version of the confluent hypergeometric 
function, see [El]). See also section 2. We did not encounter this kernel in literature, 
maybe this is a new example. 

Note that for the process with the sine kernel the points are accumulated near 
±00; for the Airy kernel — near —00; for the Bessel kernel — near +00; and for 
the Whittaker kernel — near 0. 

An important problem is studying the Fredholm determinant Det(l — XKa) 
(the test set A being an interval or a finite union of intervals), in particular, its 
asymptotics as an end of an interval tends to an accumulation point. See [TW1-5]. 

2. Lifting and the Whittaker kernel. Given a point process Q on (0, 1] and 

a probability distribution a on (0, +00), we can construct a new point process Q, 
living on (0, +00), as follows. We take the random configuration £ corresponding 
to Q and multiply it by an independent scale factor s distributed according to a. 
Choose as a the gamma distribution with density 

ds ~ F(t) ' >U ' 

Following Part II, section 3, we shall call Q the lifting of Q with parameter t. 

Let us denote by V^ z , the restriction of the process V zz > to (0, 1] C I. The 
process V^ z , governs the random behavior of the Thoma parameters oti, a 2, . . . and 
neglects the parameters /?i,/?2> • • • • On the contrary, to focus on the beta part of 
the Thoma parameters it suffices to replace z,z' by —z,—z'. 

In Part II, Theorem 3.3.4, we proved the following result: 

Theorem 2.1. Application of lifting with parameter t = zz' to the process Q = 
Vt,, gives a fermion process on (0, +00). Its kernel K(x,y) is the Whittaker kernel 



(xy) 



-1/2 



,(x)W £±£ 



z + z' + l 

2 - 



.(v)w. 



Or) 



r(z)r(*o 



X 



See section 6.1 in [El] for the definition of the Whittaker function W KjfI . 

Comments. 1) Comparison with Theorems 2.2.1 and 2.4.1 from Part II shows 
that lifting greatly simplifies the structure of the expressions for the correlation 
functions. For instance, the dimension of integrals involved in the description of 

(zz') 

the unlifted correlation functions p n grows with n while for the lifted correlation 

~(zz') 

functions p\ we need only a one-dimensional integral implicit in the definition 
of the Whittaker function. 

2) By Proposition 3.1.1 (Part II), the passage from p( 22 ') to p^ z ' is effectued 
by the integral transform £* defined in Proposition 3.2.1. This transform is readily 
reduced to one-dimensional Laplace transform and so, in principle, can be inverted 
via the Laplace inversion formula. This implies that the lifted process retains the 
whole information about the initial process. 

3) Let (cki > «2 > • • • ) be the random configuration of the process V^ z , and 
(5i > a.2 > ■ ■ ■ ) be the similar object for the lifted process. The distribution 
functions of a.\ and ol\ are also related by the transform £} and the same is true 
for joint distributions of any finite number of coordinates. 
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4) Note that the distribution of ol\ is given by the Fredholm determinant: 



Prob{«i <r} = Det(l-K (T;+oo) ), r > 0, 

where K( Tj+OQ )(x, y) is the restriction of the Whittaker kernel to (r, +00). 

5) The transform £* has a simple meaning in the language of moments. Its 
application, say, to a one-dimensional distribution results in multiplying the mth 
moment by (t) m , m = 1,2, . . .. Thus, if we calculate numerically a few moments 
of the random variable a\ then we immediately get the corresponding moments of 
a.\. 

6) The fact that application of lifting can simplify a point process is also demon- 
strated on the example of the Poisson-Dirichlet process whose lifting is simply a 
Poisson process (Part II, Proposition 3.1.2). Note that from this result one can very 
easily get Griffiths' formulas [Gl, G2] for the mean values of the random coordinates 
x\ > X2 > . . . distributed according to the Poisson-Dirichlet law. 

As a simple application of Theorem 2.1 we shall prove the following result. 

Proposition 2.2. Consider the probability space (Q,P zz i) where O is the Thoma 
simplex and P zz i is one of the measures of the principal or complementary series 
{see Part I). Let us view the Thoma parameters as random variables defined on 
this probability space and let the symbol E mean expectation. Then we have 



v i=i 



smnz ■ smivz 
7rsin7r(z — z') 



(2.1) 



where "4>{a) = T'(a)/T(a). 
Similarly, 



E 



00 

E 



3i 



sin7T2 • sin7T2 



7rsin7r(z — z') 



(z'-z) Z+ 2 Z 'j l + iP(-z)-iP(-z>) 



(2.2) 



Proof. By Proposition 4.6 of Part I, the symmetry map (a,/3) i— > (/?, a) of the 
Thoma simplex takes the measure P zz > to the measure P- Zj - Z /. On the other hand, 
the right-hand sides of the formulas (2.1), (2.2) differ exactly by change of sign in 
z, z' . So, the both formulas are equivalent, and it suffices to check one of them, say, 
(2.1). 

Let pi(x) denote the density function of the process V zz >. By the very definition 
of the density function (see Part I, §4), 



xpi(x)dx. (2.3) 



Since we know various expressions for the density function (see Part I, Theorem 
5.10, Theorem 5.12; Part II, Corollary 2.4.2), we could try to employ one of them 
to calculate the integral (2.3) explicitly. However, this does not seem to be easy, so 
we have preferred to use a roundabout way - reduction to the lifted process. 

6 




Let 5i, ct2, ■ ■ ■ stand for the "lifted" random variables «i, a 2 , . . . and p\ be the 
density function of the lifted process (see section 3.1 in Part II). Similarly to (2.3) 
we have 

(oo \ «oo 
XJ 5 *J = J xpi(x)dx. (2.4) 

On the other hand, it follows from the definition of lifting (see also Comment 5 
above) that 



f 1 1 f°° 

/ xpi(x)dx = - I xpi(x)dx, 

Jo t Jo 



where, as usual, t = zz' . 

Let K(x,y) be the Whittaker kernel (Theorem 2.1). Then 

Pi(x) = K(x,x), x > 0. 

Let us abbreviate 



z + z' + 1 z-z' 

«= 2 ' ^ = _ 2"" ' ^ ' 

and assume x > 0. Then, applying the l'Hospital rule, we get 

XMX) = T (z)T(z') {W ^ {x)Wk - iAx) ~ ^W 1 ))- ( 2 - 6 ) 
Let us employ the relation 

which follows from formulas 6.9 (2) and 6.6 (1) in [El]. Then we get from (2.5) and 
(2.6) 

-xpi{x) 

W K ^(X)W^{X) + ZZ'W^JX) - (Z-1)(Z' - \)W K „{x)W K - 2 ,»{x) 

zz' ■ T(z)T(z') ■ x 

The integral of the above expression over (0, +oo) can be found by making use 
of the table integrals 

TV 



So " (« 1 -« 2 ) 8 m(27r/i) 

1 1 



x 1 W Kl ^(x)W K2 ^(x)dx 



_r(i - ki + /u)r(i - k 2 - p) r(i - m - p)T{\ - k 2 + p) 

and 

f,- ¥ 2 (x)dx _ * ^~K + p)-^-K-p) 

Jo W ^ X)aX S m2np r(| - « + n)T{\ - « - ' 

which can be found in [PBM], section 2.19.23, formulas 3 and 4. Note that these 
two integrals are convergent provided that \^tp\ < |, which indeed holds in our 
case, because of the restrictions imposed on the parameters z, z', see §2 in Part I. 
Finally, we also need the relation 

if>(a+l) = if>(a) + - , 

Ch 

see [El], 1.7 (8). 

Then, after elementary calculations we get the desired formula (2.1). □ 
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Remark 2.3. Assume that z' = —z; according to the assumptions on the param- 
eters z, z', this means that z = —z' is purely imaginary. Then the measure P zz > 
is stable under the symmetry map transposing the a's and the /5's, so that the 
expressions (2.1) and (2.2) must be equal to 1/2. One can check that this is indeed 
the case by making use of the relation 

ip{a) — tp{—a) = —tv ctg(7ra) , 

a 

which can be found in [El], 1.7 (11). 

Further, we know that YH a i + A) = 1 almost surely with respect to P zz i (Part 
I, Theorem 6.1). It follows that the sum of the expressions (2.1) and (2.2) must 
be identically equal to 1. Again, this can be readily verified by making use of the 
above relation. 

Remark 2.4. Note that for certain special values of the parameters z, z' the Whit- 
taker kernel degenerates to the Christoffel-Darboux kernel for the Laguerre poly- 
nomials. 

Specifically, let L 2 ^ stand for the Ath Laguerre polynomial with the weight 
function x 2fl e~ x on R + , where 2[i > —1; the normalization is that of [El]. We have 



x 



^ +NH Jx) = (-l) N Mx»e-U%(x), 



see, e.g. [El], 6.9 (36). 

Assume A — 1 < z, z' < A, where A = 1,2,..., and let z' tends to A while z 
remains fixed. Denote 2/x = z — A; then —1 < 2fi < 0. Using the above formula we 
readily get that the limit of the Whittaker kernel as z' — > A is equal to 

A! _^ L^_ 1 (x)L^(y)-L^_ 1 (y)L 2 N ^x) 

T(A + 2n) [Xy) 6 x-y 



= (xyVe-^ V 

^ J(L 2 S(x)) 2 x 2 »e-*dx 



The latter expression coincides with the kernel of the projection in the Hilbert space 
L 2 (i? + , dx) on the linear span of the functions x l+fI e~% , where i = 0, . . . , A — 1; this 
is exactly the kernel associated with the " A-point Laguerre polynomial ensemble" , 
see [FK], [Br], [NW1]. 

Finally, note that the restriction \x < 0, which comes from the assumption A— 1 < 
z, z' < A, is inessential, because there exists a natural "degenerate series" of the 
measures P zz / with the parameters z' = A, z > N — 1. 

3. The tail process. Let Q be a point process on (0, 1] or on (0, +oo) and pi(x) 
be its first correlation function. We assume that p\ is integrable on the right of 
any e > and nonintegrable on (0, e), so that the points are accumulated to 0. 
Consider the mapping 



(0,1] -> [0,+oo), x^£:= / pi(y)dy, 



f 

J X 



and let Q be the image of the process Q (or rather of its restriction to (0, 1], in case 
Q is defined on the whole ray) under that mapping. Then Q is a point process on 
[0, +oo) and its first correlation measure coincides with Lebesgue measure. 

Further, for any r > 0, let Q T be the process on [— r, +oo) obtained from Q by 
the shift £ i — > £ — t. We let r — > +oo and assume that there exists a point process 
<3oo on the whole axis R such that the limit 

lim Q T = Qoo 

exists in a reasonable sense. Then we shall say that Qoo is the tail process for Q. 

Of course, the exact meaning of the limit above has to be precised. We shall 
be content with the following type of convergence: for any n, the nth correlation 
function of Q T tends, as r — > +oo, to the nth correlation function of Qoo, uniformly 
on compact sets in R. Perhaps, the definition can be elaborated. But anyway, the 
idea is clear: we restrict the initial process to a small interval (0, e), next rescale it 
to make the density function constant, and then look at the asymptotics as e — > 0. 

In the examples considered below the correlation functions of Q can be repre- 
sented in the form 

C n 

Pn(xi,...,X n ) = {fn(xi,...,X n ) + o(l)), X\ , . . . , X n > 0, 

X\ . . . x n 

where C > is a constant not depending on n, f n (xi, ■ ■ ■ ,x n ) is a continuous 
homogeneous function, 

fn(rXi, . . . , rx n ) = f n (xi, . . . , X n ) T > 0, 

and the rest term, denoted as o(l), tends to zero as max{xi, . . . , x n } — > 0. Note 
that the function fi should be a constant, and we choose C in such a way that 

/i(0 = i- 

In such a situation, we make a change of variables Xi i— > where Xi = e~^/ c . 
In the new variables, the correlation functions take the form 

Pn(fl» •••»&») =^n(Cl,---,Cn) + o(l), ^i,...,^ n G R, 

where the rest term o(l) tends to zero as min{^i, . . . , £ n } — > +00 and 

<7n(£i,-..,£n) :=/ n (e-^/ C ,...,e-WC) 

is a translation invariant function. Consequently, the desired "tail" correlation 
functions have the form 

•••,&») =^n(Cl,---,Cn)- 

As illustration, examine first the Poisson-Dirichlet process. 
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Proposition 3.1. The tail process for the Poisson-Dirichlet process VV(t) is the 
Poisson process on M with constant density 1. 



Proof. Recall that the correlation functions of VV(t) are given by Watterson's 
formula 

_ t n (l- Xl x^- 1 

Pn\%l: ■ ■ ■ i X n ) — j 

X\ . . . X n 

see [W] and Part I, Corollary 7.4. In particular, the first correlation function is 

Pl (x) = . 

These correlation functions fit into the above scheme with C = t and all the 
functions f n identically equal to 1. It follows that the "tail" correlation functions 
p n are identically equal to 1, which corresponds to the standard Poisson process. □ 

As in section 2 above, let V^ z , denote the restriction of the process V zz ' to 
(0,1] C/. 

Theorem 3.2. Take as Q the process V~^ z , or its lifting with parameter t = zz' . 
In both cases the tail process Q is a fermion process on (0, +oo) with the same 
translation invariant kernel K(£,rj), which has the following form. 

• For the principal series, when z' = z and z is not real, 

^' V) AshB^-rj)' 

where 

„ 7r sin 7i(z — z') . , „ 

B = — ^ } T > , A = ±i(z - z')B. 

2{z — z ) smnz ■ sm7r^' 

• For the supplementary series, when m < z, z' < m + 1 for a certain m G Z 
and z 7^ z' , 

{i,V) AshB^-rj)' 

where B is given by the same formula and A = ±(z — z')B . 

• Finally, on the intersection of the both series, when z = z' e K \ Z, the kernel 
is given by the limit expression 



skB^-rj) 

where 



B 



2 sin 2 ttz 



Proof. For the lifted process, the behavior of the correlation functions near zero is 
given by the asymptotics of the Whittaker kernel as described in Part II, Theorem 
4.1.1. For the process V~^ z , itself this requires knowledge of the asymptotics of the 
multivariate Lauricella functions of type B; the final result is described in Part 
II, Theorem 4.3.1. According to these theorems, the correlation functions, both in 
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lifted and non lifted case, fit into the above scheme with the same constant C and 
the same functions f n . 



Specifically, we have 
C 



(z — z') sin7rz ■ simvz' 

: 7 a ' z ^ z 

7rsin7r(z — z') 

sin 2 tvz , m . „ 
=— , z' = zeR\Z 

7T Z 



and 

fn{xi, . . . , X n ) = det[K'(xi, Xj)], 

where , , 

1 (x/y)^- - (x/y)^ 



K'(x,y) = l 



z' {x/y)l - (x/y) 2 
In x — In y 



z' ^z 



z = z' e R \ Z. 



k (x/y) 2 - (x/y) 2 

Passing from the functions f n (x\, . . . , x n ) to the functions g n (£,i, ■ ■ ■ , Cn) as de- 
scribed above we get the expressions indicated in the statement of the theorem. □ 

Remark 3.3. Let us notice two remarkable features of the expression for the kernel 
in Theorem 3.2. 

• First, the kernel does not change under the transform (z, z') i— > (—z, —z'). This 
implies that the tail properties of the CKj's are the same as that of the /3j's. 

• Second, the kernel does not change under the shift (z,z') h- > (z + l,z' + 1). 
This means a quite surprising periodicity of the tail process with respect to the 
parameters z, z' . One can ask whether this phenomenon is somehow related to 
degeneration of P zz ' at integer values [KOV] . 

4. The sin / sh and sh / sh kernels. Here we shall examine in more detail the 
kernels that appeared in Theorem 3.2. These are the stationary kernels of the form 

_ BshAjx - y) 
[X,V) ~ AshB(x-y) 

where B is real and A is either real or pure imaginary (here and below we use the 
letters x,y instead of £,77). There are two main types and two limit types: 

1) The "sin/sh kernel", 

K( ~ X ^= B A S UW X ~ y l S> °' A ^°- 
AshB(x — y) 

2) The "sh / sh kernel" , 

=!§|^& B>0 - AeR - A *°- 

3) The limit case B = 0: 

shA(x-y) m , . 

A(x-y) 

4) The limit case A = 0: 

In all the cases we normalized the kernels so that K(x, x) = 1; by a change of 
variable, x const -x, we could replace 1 by an arbitrary constant. 
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Proposition 4.1. Let K(x,y) = k(x — y) be a translation invariant kernel on 
(R, dx) and assume that k(-) is the inverse Fourier transform of an integrable func- 
tion k(-), 



such that < k(y) < 1 for all y e R and k(y) < 1 when \y\ is large enough. 

Then the conditions (*) and (**) stated in section 1 are satisfied, so that the 
kernel corresponds to a fermion process on R. 

Proof. Since k is nonnegative, the function k is Hermitian-symmetric and nonneg- 
ative definite, whence the condition (*) is satisfied. 

Let K denote the integral operator in L 2 (R, dx) with the kernel K(x,y). The 
image of K under the Fourier transform is the operator of multiplication by the 
function k. This implies that < K < 1. 

It remains to check that Ka is strictly less than 1 for any test set Act, i.e., for 
any bounded A; without loss of generality one can assume that A is a finite interval 
[a, b]. The function k being continuous, the operator Ka is a compact Hermitian 
operator. Assume Ka4> = <P for a function e L 2 (R). Then is concentrated 
on A and Kef) = <f>. Taking the Fourier transform we see that the Fourier image 
4> is concentrated on the region where k(-) = 1. By the assumption, this region 
is bounded, so that both <p and <p are compactly supported, which implies = 0. 
This means that Ka < 1, which completes the proof. □ 

Let k(x) = B sin Ax /A shBx or k(x) = B sh Ax/AshBx, where in the latter 
case we assume \A\ < B (otherwise k(x) certainly does not have the required 
form). Then the Fourier transform k(y) is given by the formula 



A[ch(7iA/B) + ch(7n//B)] 



or 

~ . 7r sm(7rA/B) 

k(y) = 



A[cos(ttA/B) + ch(ny/B)} ' 

respectively. These formulas (which are related by analytic continuation with re- 
spect to the parameter A) can be found, e.g., in [E2], section 1.9, formula 14. 

Proposition 4.2. The above four stationary kernels generate a fermion point pro- 
cess if the parameters A, B satisfy the following conditions, respectively. 
1) The "sin / sh kernel": 

, n\A\ ^ \A\ 



2B ~ 7T 



2) The "sh/sh kernel": 



tt\A\ \A\ \A\ 



3) The limit case B = 0: 



A > 7T. 
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4) The limit case A = 0: 

B > tt 2 /2. 



Proof. The above expressions for k(y) correspond to the first two cases. For the 
remaining two cases we get k(y) by an obvious limit transition. We must find 
conditions on A, B under which k(y) satisfies the two inequalities of Proposition 
4.1. This is done by an elementary calculation. □ 

Comments. 1) In our scheme, the famous sine kernel corresponds to the degen- 
erate case B = and the minimal allowed value A = tt. 

2) The "sin / sh" kernel with A = tt and arbitrary B appeared in the papers 
[BCM, MCIN]. 

3) For the principal series, when z = a + ib, z' = a — ib, where a, b are real and 
b is nonzero, the kernel of the tail process is of type "sin / sh" with the parameters 

A 7rsh(27r6) 7rsh(27r6) 



ch(27r6) - cos(2yra) ' 26(ch(2yr6) - cos(27ra)) ' 

The inequality imposed on A, B becomes evident in terms of a, b: 

ch(2-7r&) — cos(2-7ra) ^ 
ch(27r6) + 1 ~ 

Note that we do not get all the allowed couples {A, B). 

4) For the complementary series, when z and z' are real such that m < z, z' < 
m + 1 for a certain m G Z and z ^ z 1 ', the tail kernel is of type "sh / sh" with the 
parameters 

tv sin7r(z — z') 7rsin7r(z — z') 

2 sin iTZ ■ sin ttz' ' 2(z — z') sin tvz ■ sin wz' 

The first inequality imposed on A, B turns into the evident one: 

2 sin irz ■ sin irz' cos tt(z — z') — cos w(z + z') 
— cos n(z — z') + 1 cos n(z — z') + 1 

The second inequality is also evident, because 

\A\ 



B 



z'\ < I. 



Again, we do not get all the allowed couples (A, B). 

5) For the intersection of the both series, when z = z' e R \ Z, the kernel is of 
limit type with the parameters 

A = 0, B = 



2 sin 2 7tz 



and the inequality on B takes the form 



TT 2 TT 2 

> 



2 sin 2 itz 2 

As sin 2 nz ranges over (0, 1], we get here all the allowed values of the parameter B. 

6) Consider the principal series (z = a + ib, z' = a — ib) and let \b\ — > oo; then, 
irrespective to the behavior of a, the corresponding tail kernel tends to the sine 
kernel sin7r(£ — t/)/7t(^ — rj). 
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5. Rate of decay of the Thoma parameters. 



Theorem 5.1. Let P zz > be an arbitrary measure of principal or complementary 
series. Then, for almost every point u = (a, (3) G O, with respect to the measure 
P zz > , there exist the limits 

lim (a,) 1/j = lim = e~ c ~\ 

where C is the same as in the proof of Theorem 3.2, i.e., 

(z — z') simvz ■ simvz' 



c = 



sin 2 ttz 



n 



nsmn(z — z') 

., , z' = z eR\Z 



, z'^z 



Proof. Step 1 (change of a variable). We shall prove that the first limit exists and 
equals e~ c . Then this will also imply the claim concerning the second limit, 
because, on the one hand, a and (3 change places as z and z' are multiplied by — 1, 
and, on the other hand, this does not affect the value of C. 

So, we shall examine the point process V^ z , on (0, 1]. It is convenient to pass 
from (0,1] to [0, +oo) via the map x \— > £ = — \nx. Let x\ > > • • • be the 
random configuration of the process V^ z , and £i < £2 < • • • be its image under this 
map. (Actually, we know that the inequalities are strict (see Theorem 2.5.1 of Part 
II) but here this is unessential.) 

We have 

lim ( Xj ) 1/j = e- C_1 & lim ^ = C" 1 

j^QO J^OO j 

(here we mean limits with probability 1). 

Step 2 (reduction to N T ). Let £1 < £2 < • • • be the random configuration for a 
point process on [0, +00) and iV T denote the number of points in [0, r], where r > 
is arbitrary. Then the following equivalence holds (C > is a constant): 

lim & = C" 1 & lim — = C, 

limits with probability 1. 

Actually, in this claim, randomness is unessential; we shall prove it for a fixed 
(nonrandom) configuration. 

Assume that tends to C _1 with a certain C > 0. Then £j — > +00. Further, 
for any r > 0, there exists a unique j such that £j < r < Then A^ T = j and 



As r — > +00, we have j — > +00, whence, by the assumption, the both bounds tend 
to C. Consequently, N T /r tends to C, too. 

Conversely, assume that N t /t tends to a certain C > 0. Then it follows that 
£j — > +00 as j — > 00. Further, fix an arbitrary e > and remark that 



N^ £ <j<N $j 
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This implies 



As j — > 00, we have £j — > +00, whence, by the assumption, the both bounds tend 
to C. It follows that tends to C, too, so that tends to C~ x . 

Step 3 (use of correlation functions). Consider a point process on [0, +00). As 
above, by N T we denote the number of points in [0,r]. Let p\ and P2 be the first 
and the second correlation functions. 

Lemma 5.2. Assume that p\ and P2 satisfy the following conditions, where e and 
C are certain constants (0 < e < 1 and C > 0) and t — > +00; 



Pl (^ = CT + 0(r'- e ) 



r r P2(t,vndr,=c\ 2 +o(T 2 - s ). 

Jo Jo 



Then N t /t^C. 



Proof of the lemma. We shall adapt Kingman's argument in [Ki], section 4.2. By 
the definition of the correlation measures, 



Pl (Z)dS = E(N T ) 

[ T [ T P2^,v)d^d V = E(N T (N T -l)). 
Jo Jo 

By the assumptions of the lemma, this implies 

E(N T ) = Ct + 0(t 1 ~ £ ) 
E(N 2 ) = E(N T (N T - 1) + JV T ) = C 2 r 2 + 0(r 2 " e ). 

It follows 



12 I I ^ - C 



E(iV T 2 ) 2C E(N T ) , n2 



+ C 2 =0(t~ £ ). 



By the Chebyshev inequality, for any 5 > 0, 



Prob 



r 



>5 < 



const 



where the constant does not depend on r. Taking r = k 2 l e , where fe = 1, 2, . . . , we 
conclude that the series 



J^Prob 



fc=i 
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-c 



> 5 



converges for any 6 > 0. By the Borel-Cantelli lemma, 



hm -^j- = C 

with probability 1. 

Finally, for an arbitrary r > 0, define a natural k from the relation 

k 2/£ <T< (k + l) 2/£ . 

Then 

N kVs <N T < % +1) 2/s . 

Since 
we get 

l im ^L = C 

r— >+oo f 

with probability 1. □ 

Step 4 (reduction to the lifted process). Remark that multiplication of a sequence 
(x\ > X2 > ■ ■ •) by a positive factor does not affect on the limit behavior of . 
By the very definition of the lifting, it follows that in the claim of the theorem, we 
may replace our process by its lifting. The only purpose of this reduction is that 
below we may employ Theorem 4.1.1 (Part II) for the lifted process instead of the 
parallel Theorem 4.3.1 whose proof is more difficult. 

Step 5 (estimation of correlation functions). Consider the lifting of the process 
V^ z , and then make change of a variable x i— > £ = — Inx. Denote by p n (£i 5 • • •■> Cn) 
the correlation functions of the resulting process. By the above discussion it remains 
to check that pi and p 2 obey the assumptions of Lemma 5.2. 

Theorem 4.1.1 of Part II implies that our correlation functions can be written in 
the form 

Pnitu..., £n) = C n det[K(^, £,•)] + r n (£i, . . . , £»), £i, •••,£»> 0, 
where the constant C is the same as in the statement of the theorem, 



K(t,Tl) = k(Z-Tl), 

sh(^c) 



H0 = 

and the rest term admits the estimate 



(*-Osh(±c) 

c 



z = z'Gl\Z, 



rn(6,---,U = 0(e- 5min «--^>) 
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with a certain 5 > (this 5 is equal to 1 for the principal series with z' ^ z; to 
1 — \z — z'\ for the complementary series with z ^ z'\ and can be any number strictly 
less than 1, for the intersection of the both series). 

Note that k(0) = 1 and the function k(() is an even square integrable function 
on the whole real axis. 

We have 

/T n(eK = C»(l), f f r 2 (Z, v )dtd v = 0(T). 
o Jo Jo 



Using this we get 



[ T Pi(Z)d£ = C f fc(0R + 0(1) = Ct + 0(1), 
Jo Jo 

didr] + 0(r) 



i k(a - V) 



pT pT pT p 

/ / P2(^vHd V = C 2 / / 
Jo Jo Jo Jo 

[ [ k\C-v)dCdv + 0(t). 
Jo Jo 



Finally, 



= C 2 r 2 - C 2 



1 T k 2 d - V )did V = 2 f di f k 2 (()d( = O(r), 
o Jo Jo 



because k(() is square integrable. 

Thus, we have verified the assumptions of Lemma 5.2, which completes the 
proof. □ 

Remark 5.3. The same argument can be applied to the Poisson-Dirichlet process 
VT>{t). Here the final step 5 is much easier, because of a simpler structure of the 
correlation functions. We get in this way that for W(t), [xj) 1/j tends to e~\ the 
result originally obtained (for t = 1) in [VS] by a quite different way. We can also 
use lifting, as suggested on step 4, which provides a quick reduction to the law of 
large numbers for the Poisson process, see [Ki], section 4.2. 

Thus, both for V* z , and W(t), the rate of decay of the a^-'s is of the same type. 

Remark 5.4. Let fi' denote the subset of points uj = (a, f3) G O such that the limit 
F(uj) := lim(o;j) 1 /- 7 exists. Clearly, this is a Borel subset. According to Theorem 
5.1, O' is of full measure with respect to any P zz i and the function F takes constant 
values almost everywhere, with the constant depending on z, z' in a nontrivial way. 
This agrees with the fact that the measure P zz i are pairwise disjoint. However, this 
does not provide an alternative proof, because a single function is not sufficient to 
separate points in the two-dimensional space of the parameters. 

6. Associated Sturm— Liouville operators. It is well known 3 that the integral 
operator with the sine kernel, restricted to an arbitrary finite interval, commutes 
with a certain Sturm-Liouville differential operator 

Df = (pfy + qf. 



3 One of the authors (G. O.) is grateful to F. Alberto Griinbaum for drawing his attention to 
this fact. 
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Specifically, take the interval [— r, r] with r > 0; then 

p(x) = x 2 — r 2 , q(x) = ir 2 x 2 . 

Gaudin's proof of this fact, sketched in [Me], section 5.3, uses a trick but the claim 
can also be verified by brute force. 

Similar results also hold for the Airy kernel and the Bessel kernel, and they 
turn out to be useful in the study of the corresponding Fredholm determinants, see 
[TW2, TW3]. 

Now we shall produce analogous differential operators for the kernels discussed 
in section 4 and for the Whittaker kernel. 

Proposition 6.1. The integral operator with the sin / sh kernel or the sh / sh ker- 
nel, restricted to the interval [—t,t], t > 0, commutes with the Sturm-Liouville 
operator Df = (pf)' + qf , where 

, s sh 2 (Bx) - sh 2 (Br) . , (B 2 ±A 2 )sh 2 (Bx) 
P( x ) = 52 ' W = 52 

and the plus sign is taken for the sin / sh kernel while the minus sign is taken for 
the sh / sh kernel; the same is true in the limit cases A = or B = 0. 

Proposition 6.2. The integral operator with the Whittaker kernel restricted to the 
semi-infinite interval (r, +00) with arbitrary r > 0, commutes with the Sturm- 
Liouville operator Df = (pf)' + qf , where 

((a-x/2) 2 -t)(x-r) 
p(x) = x(x — t) , q(x) = , 

x 

a=(z + z')/2, t = zz'. 



Proof of the propositions. One checks by a direct computation that the kernel sat- 
isfies the relation D x K(x, y) = D y K(x, y) which implies the desired claim. □ 

7. Comparison with Poisson— Dirichlet. Like the processes V zz >, the Poisson- 
Dirichlet processes are closely related to harmonic analysis on the infinite sym- 
metric group. The both families of processes play a similar role but on different 
levels. Namely, the Poisson-Dirichlet processes describe the decomposition on er- 
godic components for certain measures. Those measures live on a compactification 
of the infinite symmetric group and are employed in the construction of the gen- 
eralized regular representations, see [KOV]. The processes V zz ' correspond to the 
dual level, as they govern the decomposition of that representations. 

Our study makes it possible to compare the both families of processes. 

The correlation functions of W(t) are given by simple formulas, those of V zz > 
look much more complicated. This is already seen for the first correlation functions. 

Both VT>(t) and V~^ z , are simplified after lifting. But the lifting of the former is 
a (non stationary) Poisson process while the lifting of the latter is a less elementary 
object — the fermion process with the Whittaker kernel. 

A similar conclusion can be made about the corresponding tail processes. These 
are the standard Poisson process and a stationary fermion process, respectively. 
This means, for instance, that the asymptotic probability distribution of the ratio 
aj/oij+i (as j — > 00) looks quite differently. 
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Thus, the processes V zz > seem to be much more sophisticated objects than the 
Poisson-Dirichlet processes. 

On the other hand, as is shown in section 5 above, there is a rough characteristic 
with respect to which W{t) and V~^ z , behave similarly: in the both cases, the rate 
of decay of the <x/'s is that of a geometric progression. 
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